Papers with lightweight proxy model
Dynamic Generation of Multi LLM Agents Communication Topologies with Graph Diffusion Models (2026.acl-long)
Copied to clipboard
Eric Hanchen Jiang, Levina Li, Frank Wan, Xiao Liang, Sophia Yin, Yuchen Wu, Xinfeng Li, Yizhou Sun, Wei Wang, Kai-Wei Chang, Ying Nian Wu
| Challenge: | Existing frameworks rely on static or rule-based topologies that fail to adapt to task requirements. |
| Approach: | They propose a generative framework that generates highly task-adaptive topologies . they validated the framework on multiple benchmarks and validated it on multiple platforms . |
| Outcome: | The proposed framework outperforms existing frameworks in task-adaptive communication topologies. |
Estimating the Black-box LLM Uncertainty with Distribution-Aligned Adversarial Distillation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing uncertainty quantification methods depend on computationally expensive multiple sampling or internal parameters, which prevents real-time estimation and fails to capture information implicit in the black-box reasoning process. |
| Approach: | They propose a distribution-aligned adjudication architecture to guide a lightweight proxy model to learn the high-quality regions of the output distribution of the black-box LLM. |
| Outcome: | Extensive experiments show that a proxy model even with 1% of the target LLM’s size can achieve reliable uncertainty quantification. |